Towards a Stable Robotic Object Manipulation Through 2D-3D Features Tracking
نویسندگان
چکیده
In this paper, a new object tracking system is proposed to improve the object manipulation capabilities of service robots. The goal is to continuously track the state of the visualized environment in order to send visual information in real time to the path planning and decision modules of the robot; that is, to adapt the movement of the robotic system according to the state variations appearing in the imaged scene. The tracking approach is based on a probabilistic collaborative tracking framework developed around a 2D patch‐based tracking system and a 2D‐3D point features tracker. The real‐time visual information is composed of RGB‐D data streams acquired from state‐ of‐the‐art structured light sensors. For performance evaluation, the accuracy of the developed tracker is compared to a traditional marker‐based tracking system which delivers 3D information with respect to the position of the marker.
منابع مشابه
CapriDB - Capture, Print, Innovate: A Low-Cost Pipeline and Database for Reproducible Manipulation Research
We present a novel approach and database which combines the inexpensive generation of 3D object models via monocular or RGB-D camera images with 3D printing and a state of the art object tracking algorithm. Unlike recent efforts towards the creation of 3D object databases for robotics, our approach does not require expensive and controlled 3D scanning setups and enables anyone with a camera to ...
متن کاملA database for reproducible manipulation research: CapriDB – Capture, Print, Innovate
We present a novel approach and database which combines the inexpensive generation of 3D object models via monocular or RGB-D camera images with 3D printing and a state of the art object tracking algorithm. Unlike recent efforts towards the creation of 3D object databases for robotics, our approach does not require expensive and controlled 3D scanning setups and aims to enable anyone with a cam...
متن کاملVision Techniques for Robotic Manipulation and Grasping
In this paper we present a few different vision techniques used for robotic manipulation and grasping tasks. These tasks are performed in a domestic environment and consider manipulation of everyday objects such as a package of cereals, cups, soda cans, etc. The variety and dynamics of real world settings introduce a number of problems such a varying lighting conditions, complicated textural pr...
متن کاملA 2D-3D Hybrid Vision System for Robotic Manipulation of Randomly Oriented Objects
This paper presents an new vision technique for robotic manipulation of randomly oriented objects in industrial applications. The proposed approach uses 2D and 3D vision for efficiently extracting the 3D pose of an object in the presence of multiple randomly positioned objects. 2D vision permits to quickly select the objects of interest for 3D processing with a new modified ICP algorithm (FaR-I...
متن کاملVisual Tracking using Dynamic Transition in Groups of Affine Transformed Templates
Visual tracking plays an important role in various robotic tasks such as monitoring an object during manipulation or tracking a target during navigation of a mobile robot. This paper presents a view-based visual tracking system. View-based s y s t ems are m o r e general than the other approaches which require a n a lysis of 2D image features and matching with 3D models. For the image correlati...
متن کامل